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INTERNET BROWSING FROM A TELEVISION 



Cross Reference To Related Applications 
This application claims the benefit of the U.S. 
Provisional Application No. 60/161,700, filed on October 26, 
1999. 



The present application describes a technique for 
automatically capturing Internet addresses that are broadcast 
as part of an entertainment media. 

Many commercials on entertainment media, such as 
television and radio, include an Internet address therein. 
For this part of the advertising to be effective, the user 
must remember these Internet addresses, since they are 
broadcast as part of the commercial. Therefore, the Internet 
addresses broadcast on such media are only really effective 
when they refer to an easy-to-remember domain name. 

The simple domain names, unfortunately, are valuable and 
limited commodities. Great cost can be associated with 
obtaining a simple name of this type. 
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In addition, since the address to be displayed must be 
simple, it does not readily allow any complicated addresses, 
e.g., subdomains within the main domain. 

Non-commercial parts of the entertainment media can also 
5 display Internet addresses. For example, a web site 

associated with a TV show can be displayed during the credits 
of the TV show. 



information from an entertainment media to be communicated to 
a computer or other device, which runs an Internet interfacing 
program, such as a web browser. 

In one aspect, the present system automatically calls up 
15 the web address that is transmitted by the entertainment 



In another aspect, the web address is saved for later 

use. 

The web address can be coded to include information about 
20 its source. This enables determination of the effectiveness 
of the advertisement. 



SUMMARY 



10 



The present application teaches a system of allowing 



media . 
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BRIEF DESCRIPTION OF THE DRAWINGS 

These and other aspects will be described in detail with 
reference to the accompanying drawings, wherein: 

Figure 1 shows a block diagram of a first embodiment that 
5 recognizes the hyperlink; 

Figure 2 shows a modification in which the remote 
includes a receiver element; 

Figure 3 shows a paradigm in which the service provider 
participates in sending the desired hyperlink to the user; and 
10 Figures 4A and 4B show browsing on a PDA. 



DETAILED DESCRIPTION 

Figure 1 shows an embodiment of the present invention, in 
which the entertainment media is a television system. 

15 A television receiving system 100 is shown receiving a 

television broadcast 102. The television receiving system 
includes at least a television receiver element 104, and may 
also include a television view screen 108. The television 
broadcast can be via standard transmission, satellite 

20 reception, or cable reception or via any other medium for 
television broadcast. 

Some parts of the television broadcast may include 
Internet addresses. This can be part of the program broadcast 
or part of a commercial associated with the television 
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broadcast. The Internet address is often transmitted as part 
of the seen part of the broadcast 102. 

The television also includes a user interface, generally 
shown as 110. The user interface can include one or more of a 
5 control panel on the television, a remote control operable by 
a user, and/or a voice recognition remote control which 
recognizes voice-activated commands. The user can enter 
various commands via the user interface 110 include commands 
to turn-on the television, turn-off the television, change the 
10 channels, and the like. 

Figure 1 shows the user interface being a wireless remote 
control, but the user interface can be part of the television, 
or part of some other device. 

This remote control can also operate the TV. The remote 
15 can be infrared, for example. The infrared remote embodiment 
is a retrofit system for existing television sets. The remote 
itself is preprogrammed with, or learns codes to, control the 
television. The remote control can include computing 
intelligence therein. For example, the remote control can be 
20 a personal digital assistant, e.g., a Palm™ computer, 
programmed to operate as a remote. 

The user interface 110 also includes a "browse" function 
112. The browse function is actuated when the user wants to 
use the Internet address that is associated with currently- 
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displayed information on the television screen 108. In a 



particularly preferred embodiment, actuation of the "browse 



button 112 takes some action on an Internet address that is 



displayed on the television display screen. 



5 



An information recognition module 120 is associated with 



the television set. This module 120 may be within the 
television set, or, as shown, within the remote control. In a 
first embodiment shown in Figure 1, the recognition module can 
be a "miniature camera, located within the remote control 

10 system. The recognition module 120 obtains an image of the 
picture on the television screen 108 by integrating the 
picture for the time of one or more fields and one or more 
frames. A processor within the information recognition unit 
treats the acguired picture as an image, and optically 

15 character recognizes ("OCR") the characters within the image. 
Optical character recognition programs are known, 
including programs such as Adobe Circulate™ and Caere Omni 
page™. 

An image is obtained responsive to the browse command, 
20 the image is optically-character-recognized, and the 

automatically-recognized image is processed to automatically 
determine a Internet address therein. Automatic detection of 
hyperlinks can be done by searching for key terms such as 
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"http" or "www" or ".com", ".net" or others 
(.shop, .web, .firm, .arts, .rec, .info) . 

This can also be done by correlating each letter of the 
alphabet across the entire image. For example, the letter "a" 
5 can be correlated against the entire image to find all "a"s or 
close matches to "a"s in the image. By following this 
procedure throughout the entire image, the closest match to 
letters can be found within the TV image. 



10 action related to the hyperlink. Figure 1 shows the remote 
110 being equipped with a short-range communication device 
130. This capability can be on a so-called "part 15" 
frequency, e.g. 48Mhz; 900Mhz; or 2.4Ghz. A particularly 
interesting communication technique is via Bluetooth™ 

15 communication. The communication could also be via wireless 
Ethernet or wired Ethernet. A message 128 is formed based on 
the automatically-recognized hyperlink within the television 
image. That message is sent to the communication device 130, 
and wirelessly transmitted as 135. Information is transmitted 

20 in this format to a personal computer 150. The PC receives 
the automatically-recognized hyperlink. 

If the PC or laptop is running and connected to the 
internet, the address represented by the hyperlink is 
accessed. The web page is read out and displayed. 



The obtained hyperlink information is used to take some 
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Alternately, information can be added to the computer, which 
causes the PC to bring up the web page represented by the 
hyperlink at the next time the computer is started, or the 
next time that the browser is started. This can be set as a 
5 temporary start page that will be shown only the next time the 
browser is started. 

Alternatively, the information can be added to the user's 
"Favorites" list, e.g. in a subdirectory called "Look at for 
further information" . 

10 A second embodiment carries out the recognition within 

the television unit itself. The "browse" command can still be 
controlled based on a command from a separate remote. A 
buffer in the TV is used to store an entire frame of RGB 
information. That information is converted to a gray-scale 

15 image. The information in the image is optically-character- 
recognized. The hyperlink detection is carried out in the 
same way as in the first embodiment described above. The 
information recognition unit 121 in the television unit is 
used. 

20 This embodiment may require modifying the television to 

include the information recognition unit. 

Another embodiment marks the hyperlink in alternative 
ways. For example, when the hyperlink is displayed on the 
screen, it can also be marked as a hyperlink in another 
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portion of the television signal, such as in the vertical 



blanking interval. Line 16 or 21 of the vertical blanking 



interval can, for example, include digital information 



indicative of one or more hyperlinks. 



5 



Another option reads the hyperlink from within the closed 



captioning information of the TV signal. This text can be 
directly used as an Internet address. 

In this embodiment, the information recognition unit 120 
or 121 is a closed captioning decoder. 



200 within the remote 110. The receiver could be a TV tuner 
202 and/or FM tuner 204. The hyperlinks associated with the 
entertainment program are transmitted on the TV band, e.g. in 
the closed captioning portion, or in, the FM band. The signals 

15 are received by the receiver 200. The receiver 200 is 
constantly receiving the Internet addresses, if any, 
associated with current media programs. Pressing the "browse" 
button 112 causes the currently-received hyperlink to be 
transmitted by a short range communication protocol, such as 

20 by Bluetooth™, to the PC. 

The TV remote can have a receiver for closed caption 
information, or for other information within the VBI. This 
allows the TV remote to be used with the existing television 
systems and sets, with no modification whatsoever. All new 



10 



Another option shown in Figure 2 uses a separate receiver 
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circuitry (if any) is placed within the remote. If a 
programmed computer or PDA is used as the remote, then all the 
changes necessary may include reprogramming the user 
interface . 



associated with the television (e.g., VCR, cable box, or 
satellite box) , can also receive a hyperlink from within the 
received signal, e.g. coded within the signal. That hyperlink 
is selected by the browser actuations. 



hyperlink operates by sending information to a service 

provider, rather than to the PC. 

Figure 3 shows this being done over the broadcast channel 

for two-way media is being used, e.g., in digital cable or 
15 satellite. The browse button sends either the hyperlink 

information to the service provider, or just the timing and 

channel of the browse actuation to the television provider. 

In the latter case, the television provider stores a database 

350 defining which hyperlink was displayed at any given time. 
20 In this embodiment, the television and/or remote need not 

even recognize the hyperlink. Rather, an indication is 

provided to the cable or satellite company to send more 

information to the user about that hyperlink. 



5 



In another embodiment, the television or set top box 
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An alternate way of taking the action based on the 
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Since the cable or satellite company must have an account 
with the user, it knows the user's email address. Upon 
receiving an indication that the user wants more information 
about the hyperlink that is displayed on the television at 
5 that specific time, the cable/satellite company sends an email 
either to the sponsor or the user directly. The sent e-mail 
can indicate the web page address. 

This embodiment is also suitable for use with radio, 
since it does not require reading off of the screen. 
10 A new business method becomes possible in this 

embodiment. The cable/satellite company can charge a fee for 
this service, e.g. charging a few cents for each user who 
receives such an e-mail. 



15 display a hyperlink that includes an indication of its origin. 
The web page address is tagged with an indication of the 
service provider or the specific commercial. For example, a 
web page address www . pt . web/inf o=cbs ; sd; 101999; 838 could call 
up the site pt.web, and provide the site with the identifying 

20 information - cbs (network) , sd (geographical area) , date of 
commercial airing (101999) and time of commercial airing 
(838) . That tagged web page address hence uniquely indicates 
the source of the initiation via a specified commercial or 
program. 



Another embodiment uses the power of this system to 
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The advertisers can use this to determine which times are 
most successful for web page actuations. The service provider 
can negotiate a fee for each tagged visit to the web site. A 
new method of doing business enables using these complicated 
internet addresses, since the web site is automatically called 
up from the address. In this new method of doing business, 
the service provider can guarantee a specified number of 
"hits'' from the commercial. If less hits are obtained, the 
advertiser may get a discount. The advertiser may also agree 
to pay additional amounts for "hits" beyond that guaranteed 
number . 

The desired internet information can be displayed 
directly on the television. It is known to include internet 
information over the same channel that is carrying television 
information, e.g. internet over cable (by cable modem), 
internet by satellite and the like. Alternately, a telephone 
line or dsl connection can be connected to the TV, and a web 
TV system or other equivalent system can be used to browse the 
internet using the screen of the television set. According to 
this system, actuation of the "browse" button cause either the 
screen to switch to an internet browsing window, or to a 
picture-in-picture type system, with the television program 
remaining in one picture, and the web browser opening in a sub 
picture . 
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The alternative is of course possible, where the web 
browser opens in the main picture, or two side-by-side 
pictures may be provided. 

Another embodiment operates with a computer video card 
5 that also includes a TV tuner, such as the ATI All in 

Wonder (TM) . In this case, TV can be received and viewed on 
the computer. The same computer can also operate as a 
conventional computer, e.g., to receive and display Internet 
information. This embodiment uses the information in the TV 
10 (or radio) program to launch and run an Internet page. This 
information can be displayed on the video, or coded into some 
other part of the TV signal, or transmitted on some other 
channel . 



15 system for sales-type TV, e.g., shopping channels and 

inf omercials . In these media, a salesman extols the virtues 
of a product, while trying to get the viewers to buy the 
product. Hyperlinks can be visible or hidden during this 
sales pitch. The hyperlinks can bring up supplemental 

20 internet information, or can be directly linked to a product 
order site and/or shopping cart. Hence, by actuating the 
browse key, the user's computer can be actuated to bring up 
the order form for a product and to begin the ordering 
process . 



Another method of doing business is made possible by this 
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As described above, one embodiment uses a PDA as the 
remote. The PDA has infra red or RF (e.g., Bluetooth), 
transmission capability. The PDA can also carry out certain 
functions. For example, since PDAs, such as the Palm™ 
computer, are capable of hot sync, they can exchange 
information with another computer, which is presumably a more 
powerful ("thicker") client. Therefore, the PDA can store the 
information about the hyperlink, and only later, during the 
next hot sync, download it to the main computer. The software 
running the hot sync can act on the hyperlink as described 
above, e.g., use it next time, add it to favorites, etc. 

Also, the shopping information can be supplemented by 
using the PDA. The hot sync forms an exchange of information, 
where the thicker client is notified of the PDA's request for 
information. The thicker client accesses the Internet or some 
other information source and obtains more information. Then, 
the PDA is provided with more information about any items 
where a shopper has expressed interest. That information can 
be displayed on the PDA, or on the main computer. 

A shopping list, or wish list, can also be stored on the 
PDA, for example. 

Another embodiment teaches web browsing using a personal 
digital assistant such as the Palm. In this embodiment, as 
noted above, the Palm is configured as a remote control, 
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either to produce infra red signals, or some other kind of 
signals such as Bluetooth signals which can be received by the 
entertainment medium. The mote has conventional controls, 
such as numeral keys 401, up/down keys 402, mute button 403, 
etc. In addition, the PDA either has its own receiver 
installed to independently receive hyperlinks either on the 
same channel as the television signal, or on a different 
channel. Alternatively, the PDA can receive hyperlink 
information from a transmitter on the TV, which can transmit 
by infrared or Bluetooth or the like. 

One of the available actuations on the PDA-simulated 
remote is a "browse" actuation 400. When this actuation is 
actuated, the PDA will begin a browsing actuation to a 
currently displayed hyperlink 405. In one embodiment as shown 
in Figure 4A, the PDA can also have a section within the 
remote control which can display either the hyperlink, a title 
of the web page represented by the hyperlink, or the like. The 
hyperlink can also be any of the previously-described 
hyperlink systems. 

When the browse button 400 is actuated, the PDA is 
reconfigured from being a remote control into being a web 
browser, using wireless web browsing techniques, such as used 
on the Palm VII. The web browser can use any of the 
conventionally available techniques of PDA web browsing, 
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including a wireless modem, or a short range communication 
system such as Bluetooth to communicate between the PDA and 
some server computer such as the user's own PC. One stop 
wireless web actuation can thereafter be carried out. During 
5 the web actuation, a screen as shown in Figure 4B is 

displayed. This includes the screen showing the web actuation 
and may also include a special return button 450 which enables 
returning to the remote control function. If the user presses 
the return button 450, he returns to the remote control 

10 function The web page remains in memory, and the remote 

control also shows the "switch" icon 452. In this way, the 
user can toggle to the remote control function, carry out some 
operation on the entertainment media, such as muting the TV 
for example, so that they can better concentrate, and then 

15 return to the browsing to read the contents of the web page. m 
Although only a few embodiments have been disclosed in 
detail above, other modifications are contemplated and are 
possible. All such modifications are intended to be 
encompassed within the following claims. For example, while 

20 this application has described television as being the 

entertainment media, the same operations can be carried out 
for other media. For example, radio could be continually 
stored in a buffer of 30 seconds, and then voice recognition 
techniques could be used to automatically determine hyperlinks 
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within the radio broadcast. Radio could also transmit 
hyperlinks on a separate carrier, as described above for 
television. 

All such modifications are intended to be encompassed 
within the following claims. 
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